Python Job: Data Engineer(Python-Pyspark, Azure)

HI

This is Mukul from V link . We have an urgent Requirement of Data Engineer(Python/Pyspark, Azure) in Mississauga, ON

Role: Data Engineer(Python/Pyspark, Azure)

Location: Mississauga, ON (hybrid)

Overview:

Looking for an Integration engineer responsible for daily support and project based development of credit risk management systems. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation and load of data functions.

This is an opportunity to gain experience in risk management processing using new technologies.

Responsibilities:

• Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
• Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
• Developing EL pipelines in and out of data warehouse using combination of Data bricks, Python and Snow SQL.
• Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
• Provide production support for Data Warehouse issues such data load problems, transformation translation problems

Requirements:

• You are:
• Minimum 10 years of designing and implementing an operational production grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
• Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL
• Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies

It would be great if you also had:

• Experience with Snowflake
• Detail-oriented, ability to turn deliverables around quickly with a high degree of accuracy
• Strong analytical skills, ability to interpret business requirements and produce functional and technical design documents
• Good time management skills Ability to prioritize and multi-task, handling multiple efforts at once
• Strong desire to understand and learn domain.
• Experience in a financial services/banking industry
• Ability to work in a fast paced environment; to be flexible and learn quickly.
• Ability to multi-task with attention to detail/ prioritize tasks.

Education

• Bachelors degree in Computer Science or Finance

Mukul Rawat

Phone: ext. 211 | Locations: USA, India, Indonesia